go-algorand 3.17.0-stable Release PR #5633

Algo-devops-service · 2023-08-03T16:22:17Z

Overview

Go-algorand 3.17.0 is a maintenance release that fixes some minor issues, cleans up stale code, upgrades the Algod client to Go version 1.20, and introduces enhancements such as backup DNS bootstrap support and initial PC trace support.

What's New

🌐 Network Resiliency: Algod now supports multiple DNS providers for bootstrapping onto the network increasing network resiliency against DNS failures.
💻 Go-lang upgrades: go-algorand now requires Go version 1.20, a change that improves the security and performance of internal Algod functionality.
🤝 Agreement: We have externalized our go-algorand's implementation of its cryptographic sortition to better manage its dependencies and make it usable as a separate library (see here for implementation details).
📦 Container: Multi-algod container setup is now supported. This is great for those who want to set up a private network with networking enabled as well as adding peers to a non-standard relay node.
👁️ Improved error handling: Algod will now return an error if it is unable to begin fast catchup providing a better user experience when trying to start a node.
🐛 Smart Contract Debugging: simulate PC-based execution trace has been introduced including both stack and scratch slot changes. This is one of the final building blocks towards the full debugger experience.

Changelog

New Features

Algod: Leverage 2 SRV record providers for resolving relay addresses w/ de-duplication. (#5087)
Algod: Simulate endpoint scratch-change exposure (#5563)
Algod: Simulate endpoint stack-change exposure (#5440)
Algod: Simulation PC exposure for App approval/clear-state transaction (#5360)

Enhancements

API: Allow DELETE calls (#5515)
AVM: Increase coverage by deleting a dead function and adding limit tests (#5422)
AVM: Some error cleanup, and added coverage (#5441)
Algocfg: Add EnableTxnEvalTracer to algocfg development profile. (#5481)
Algocfg: Remove block validation override from participation profile. (#5502)
Algod: Add README file to state proof package (#5386)
Block-generator: conduit performance benchmark scenarios. (#5532)
Blockserver: Memory counter for http block requests (#5428)
Build: Disable goexperiments in our builds due to issue present in Go 1.20.5 (#5484)
Build: Golang 1.20 upgrade. (#5462)
Build: Split nightly job into its own workflow. Remove ARM64 platform builds from our triggered/on commit builds. (#5485)
Build: remove boost dependency and internal sortition package (#5459)
Build: remove sqlite from release configurations (#5562)
Build: update falcon to v0.1.0 for new CFLAGS (#5460)
Catchpoint: use read connection for data retrieval for spver hash calculation (#5592)
Catchup: Add HEAD request to catchpoint service start (#5393)
Catchup: Catchup variable reuse (#5551)
Chore: Small cleanups for clarity (#5526)
Chore: Use exp/slices and exp/maps to simplify some code (#5479)
Chore: Use strings.Cut for clarity (#5474)
Chore: remove a redundant argument to maintain single source of truth (#5530)
Chore: use string builder instead of string concatenation in catchup service (#5572)
Ci: Don't run tests during benchmark (#5491)
Cicd: Update docker containers to newer versions (#5529)
Cicd: Update ubuntu circleci image and orbs (#5564)
Circleci: Update macos xcode versions (#5590)
Cleanup: Remove indexer v1 from codebase (#5477)
Cli: clarify program source flag description (#5571)
Config: make Tx dedupe cache maxSize configurable (#5419)
Config: update MaxCatchpointDownloadDuration to 12h (#5503)
Docker: Additional private network options and container tweaks. (#5525)
Encoding: Update go-codec version. (#5471)
Genesis: add GenesisAccountData type for use in GenesisAllocation (#5463)
Goal: support simulate scratch in exec trace (#5589)
Lint: enable govet shadow linter and resolve linter warnings (#5261)
Lint: enable staticcheck for test code and fix issues (#5401)
Metrics: Add LedgerDBRound gauge (#5456)
Network: Limit message length based on Tag (#5388)
Network: discard unrequested or stale block messages (#5431)
Network: improve MsgOfInterest message handling (#5476)
Network: peer selector expansion and PeersPhonebookArchivalNodes (#5385)
Network: ws block byte limiter (#5472)
Perf Tests: use metrics for memory usage charts (#5565)
Runtime: Add delete-if-exists check for the no longer used indexer.sqlite file… (#5531)
Sortition: use external sortition package (#5429)
Tests: Fix catchpoint catchup tests to use relay for catchup (#5507)
Tests: Get rapid into the codebase (#5437)
Tests: Replace timer with counter loop in TestNodeTxHandlerRestart (#5533)
Tools: Block Generator Apps. Part 2: boxes (#5478)
Tools: Block-generator Applications. Part 1: create (#5450)
Tools: EvalDelta and ConsensusParams x-repo type checks (#5381)
Tools: Reorganize block generator scripts. (#5582)
Tools: let catchpointdump to calculate and print data hashes (#5584)
Tools: prepare block-generator for configuring apps (#5443)
Tools: replace upload_metrics (#5470)
Tools: txn replayer (#5420)

Bugfixes

Bugfix: ensure blockservice callbacks are not nil (#5518)
Ci: don't use deprecated set-output in github actions (#5453)
Docker: Start kmd in the background. (#5514)
Docker: fix slow docker container start up (#5513)
Docs: Fix broken markdown in follower documentation. (#5585)
Fix: goal clerk rawsend print pending round rather than ptr to round (#5499)
Flake: TestLedgerContinuesOnVotersCallbackFailure (#5454)
Follower: Use Buffered syncNow channel to correctly trigger sync in private networks (#5516)
Goal: account info with deleted asset suppress error and better output (#5504)
Ledger: fix catchpoint pending hashes locking (#5534)
Ledger: move MakeCatchpointReader back to the Reader interface (#5583)
Ledger: use single SP verification hash/data query for catchpoint tracking & generation (#5579)
Netgoal: fix large db generation (#5445)
Tests: fix rawsend.sh nightly test failure (#5519)
Tests: reenable TestVotersReloadFromDiskPassRecoveryPeriod (#5496)
Tools: block generator inner transactions (#5506)
Tools: bugfix block-generator to handle conduit's Init block requests (#5449)
Tracer: Default to ledger tracer when starting new evaluator (#5521)

Protocol Upgrade

This release does not contain a protocol upgrade.

Additional Resources

…lgorand#5436)

…ests (algorand#5422)

…d#5261)

algorand#5360) Co-authored-by: Jason Paulos <[email protected]>

Co-authored-by: algoidan <[email protected]>

…rand#5383)

…#5216) Co-authored-by: Pavel Zbitskiy <[email protected]>

Also move tools/x-repo-types CI checks into gh actions from CircleCI Co-authored-by: cce <[email protected]>

Co-authored-by: chris erway <[email protected]>

…algorand#5449)

…w/ de-duplication. (algorand#5087) Co-authored-by: Will Winder <[email protected]> Co-authored-by: cce <[email protected]>

…cking & generation (algorand#5579) Co-authored-by: Pavel Zbitskiy <[email protected]>

Co-authored-by: Will Winder <[email protected]>

…service (algorand#5572)

…culation (algorand#5592)

…and#5583)

…ta-remerge

codecov · 2023-08-03T16:42:21Z

Codecov Report

Merging #5633 (a0e31a7) into rel/stable (cbccc6d) will increase coverage by 0.43%.
The diff coverage is 64.57%.

@@              Coverage Diff               @@
##           rel/stable    #5633      +/-   ##
==============================================
+ Coverage       56.04%   56.48%   +0.43%     
==============================================
  Files             451      450       -1     
  Lines           63307    63541     +234     
==============================================
+ Hits            35481    35889     +408     
+ Misses          25405    25260     -145     
+ Partials         2421     2392      -29

Files Changed	Coverage Δ
agreement/actor.go	`47.36% <ø> (ø)`
agreement/autopsy.go	`0.00% <0.00%> (ø)`
agreement/cryptoRequestContext.go	`100.00% <ø> (ø)`
agreement/demux.go	`91.20% <0.00%> (ø)`
agreement/events.go	`67.55% <ø> (ø)`
agreement/proposalManager.go	`96.36% <ø> (-1.82%)`	⬇️
agreement/proposalStore.go	`100.00% <ø> (ø)`
agreement/proposalTracker.go	`94.44% <ø> (ø)`
agreement/router.go	`99.02% <ø> (ø)`
agreement/sort.go	`100.00% <ø> (ø)`
... and 136 more

... and 29 files with indirect coverage changes

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

ahangsu and others added 30 commits May 31, 2023 12:14

test: skip flaky test TestVotersReloadFromDiskPassRecoveryPeriod (a…

8d73f00

…lgorand#5436)

AVM: Increase coverage by deleting a dead function and adding limit t…

4106d22

…ests (algorand#5422)

Testing: Get rapid into the codebase (algorand#5437)

25eb57c

lint: enable govet shadow linter and resolve linter warnings (algoran…

6e245e7

…d#5261)

Algod: Simulation PC exposure for App approval/clear-state transaction (

bad81ee

algorand#5360) Co-authored-by: Jason Paulos <[email protected]>

tools: txn replayer (algorand#5420)

fd946dd

Algod: Add README file to state proof package (algorand#5386)

21dd74a

Co-authored-by: algoidan <[email protected]>

kv: add StorageEngine config

76942c4

build: fix shadow linter in debug tools (algorand#5442)

e249905

Bookkeeping: improve block documentation since no-low-resources (algo…

eac2c4f

…rand#5383)

config: make Tx dedupe cache maxSize configurable (algorand#5419)

3cbb422

cleanup: remove redundant method LookupAccountDataByAddress (algorand…

7d8525e

…#5216) Co-authored-by: Pavel Zbitskiy <[email protected]>

sortition: use external sortition package (algorand#5429)

f66a404

AVM: Some error cleanup, and added coverage (algorand#5441)

490fd3b

lint: enable staticcheck for test code and fix issues (algorand#5401)

45cf9ab

config: let go-generate to produce config-vXX.json files (algorand#5446)

47dec14

typo: Fix typo in blockService_test.go (algorand#5448)

5faa4d0

block rpc: Memory counter for http block requests (algorand#5428)

913478a

tools: EvalDelta and ConsensusParams x-repo type checks (algorand#5381)

4b70342

Also move tools/x-repo-types CI checks into gh actions from CircleCI Co-authored-by: cce <[email protected]>

api: Fix errFailedRetrievingStateDelta response. (algorand#5452)

1994341

CI: don't use deprecated set-output in github actions (algorand#5453)

6b712a1

Co-authored-by: chris erway <[email protected]>

tools: bugfix block-generator to handle conduit's Init block requests (…

1230e9a

…algorand#5449)

Algod: Leverage 2 SRV record providers for resolving relay addresses …

9f8cc8d

…w/ de-duplication. (algorand#5087) Co-authored-by: Will Winder <[email protected]> Co-authored-by: cce <[email protected]>

netgoal: fix large db generation (algorand#5445)

3fbc4b6

build: remove boost dependency and internal sortition package (algora…

78b0a81

…nd#5459)

build: update falcon to v0.1.0 for new CFLAGS (algorand#5460)

fd60def

network: peer selector expansion and PeersPhonebookArchivalNodes (alg…

d5593a4

…orand#5385)

tools: prepare block-generator for configuring apps (algorand#5443)

5ff0c22

genesis: add GenesisAccountData type for use in GenesisAllocation (al…

8ab4aad

…gorand#5463)

AVM: proper cross product check for app put and del (algorand#5467)

9a644f6

winder and others added 17 commits July 20, 2023 10:13

docs: Fix broken markdown in follower documentation. (algorand#5585)

279605a

Algod: Simulate endpoint scratch-change exposure (algorand#5563)

be237d6

tools: let catchpointdump to calculate and print data hashes (algoran…

bc9f126

…d#5584)

ledger: use single SP verification hash/data query for catchpoint tra…

0e0b26d

…cking & generation (algorand#5579) Co-authored-by: Pavel Zbitskiy <[email protected]>

goal: support simulate scratch in exec trace (algorand#5589)

17d4ebf

CircleCI: Update macos xcode versions (algorand#5590)

548399e

cli: clarify program source flag description (algorand#5571)

1a46ceb

Co-authored-by: Will Winder <[email protected]>

chore: use string builder instead of string concatenation in catchup …

4a5095e

…service (algorand#5572)

build: remove sqlite from release configurations (algorand#5562)

fbfbea1

tools: Reorganize block generator scripts. (algorand#5582)

b4f6b1f

catchpoint: use read connection for data retrieval for spver hash cal…

0c6a328

…culation (algorand#5592)

ledger: move MakeCatchpointReader back to the Reader interface (algor…

197bfb6

…and#5583)

Merge branch 'rel/beta' into onetechnical/relbeta-remerge

8f4f71b

Remove buildnumber.dat and genesistimestamp.dat files

2258edd

Merge pull request algorand#5600 from onetechnical/onetechnical/relbe…

1d1fe0f

…ta-remerge

Update the Version, BuildNumber, genesistimestamp.data

fbdcd05

Merge pull request algorand#5601 from Algo-devops-service/relbeta3.17.0

a0e31a7

Algo-devops-service requested a review from a team as a code owner August 3, 2023 16:22

Algo-devops-service requested review from excalq and algobarb August 3, 2023 16:22

onetechnical self-assigned this Aug 3, 2023

onetechnical requested review from winder, gmalouf, algorandskiy and bbroder-algo August 3, 2023 16:25

algorandskiy approved these changes Aug 3, 2023

View reviewed changes

winder approved these changes Aug 4, 2023

View reviewed changes

algojohnlee merged commit f239f80 into algorand:rel/stable Aug 4, 2023
8 checks passed

onetechnical deleted the relstable3.17.0 branch August 4, 2023 16:17

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

go-algorand 3.17.0-stable Release PR #5633

go-algorand 3.17.0-stable Release PR #5633

Algo-devops-service commented Aug 3, 2023 •

edited by onetechnical

Loading

codecov bot commented Aug 3, 2023 •

edited

Loading

go-algorand 3.17.0-stable Release PR #5633

go-algorand 3.17.0-stable Release PR #5633

Conversation

Algo-devops-service commented Aug 3, 2023 • edited by onetechnical Loading

Overview

What's New

Changelog

New Features

Enhancements

Bugfixes

Protocol Upgrade

Additional Resources

codecov bot commented Aug 3, 2023 • edited Loading

Codecov Report

Algo-devops-service commented Aug 3, 2023 •

edited by onetechnical

Loading

codecov bot commented Aug 3, 2023 •

edited

Loading